Name: Itzhak Sapir 
Citizenship: Israel 
Address: 27, Foxhill 
Irvine, CA, USA 92604 
Phone number: 949-552-6499 
e-mail: sapir@home.com 

TITLE OF INVENTION 

A METHOD AND SYSTEM FOR PARTICIPATING IN REMOTE EVENTS 

CROSS-REFERENCE TO RELATED APPLICATIONS 
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BACKGROUND OF THE INVENTION 

Field of the invention 

The invention relates to methods and systems for acquisition of real life events' 
data in one location and transmission of this data to another location for use at this 
location. 

Description of the related art 

Currently there are systems that allow transmission of data acquired by sensors 
in one location to another location for reproduction at that new location. These 
systems include television broadcasting, surveillance systems (with cameras, 
microphones etc.) and other such systems. 

Several systems have capabiUties such as capture and transmission of 3-D images, 
multi directional sound acquisition and even sensing and transmitting of smell data. 
These acquisition systems are passive. The do not participate in the event and do not 
have a bi-directional interaction with the event. The event's course of action is not 
influenced by the existence of TV cameras and surveillance systems and any such 
monitoring systems. In addition, these systems usually offer sound and vision capture 
only. 

Independently, there are systems for reproduction of pre-programmed actions 
and user controlled actions such as computer and arcade games and simulators 
including those that have actuators that add motion to the reproduction experience. 
These systems are not combined with real hfe events' acquisition systems and usually 
contain artificial imitation of real life events. 

At this time, no system offers a multi-sensory, event involved, capture and 
reproduction of real life events. 
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BRffiF SUMMARY OF THE INVENTION 

The present invention is a system and method that allows individuals and 
groups to participate in a multi-sensory experience (either passive using a 
unidirectional system or active with a bi-directional system) that receives inputs from, 
and interacts with real life events that happen in remote places. 
The proposed system consists of three maj or parts : 

- The sensing platform - A platform that contains on or more sensing devices 
(cameras, microphones, motion sensors etc.) and that is positioned at the site of 
the monitored event 

- The reproduction platform/platforms - One or more platforms, each containing 
one or more systems for reproducing certain parts of the monitored event 
(displays, VR goggles, headphones, loudspeakers, moving chairs etc.). The 
platform/platforms are to be positioned in places were the reproduction of the 
event is wanted 

- The communication system - A system that transfers the data received from 
the sensors in the sensing platform to the reproduction systems in the 
reproduction platforms at the required data rate for allowing real time 
reproduction of the monitored event. 

The method and system are mainly aimed at the entertainment and virtual fravel 
markets but can be used for education, research and other areas. 

Key features of the present invention are multi-sensory capture of real Ufe events 
with an event-involved platform and multi-sensory reproduction of these events 
with one or more reproduction systems. 
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BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
Not applicable 

DETAILED DESCRIPTION OF THE INVENTION 

The present invention is a system and method that allows individuals and 
groups to participate in a multi-sensory experience (either passive using a 
unidirectional system or active with a bi-directional system) that receives inputs from, 
and interacts with real life events that happen in remote places. 
The method and system are mainly aimed at the entertainment and virtual travel 
markets but can be used for education, research and other areas. 

System description 

The proposed system consists of three major parts: 
The sensing platform - A platform that contains on or more sensing devices 
(cameras, microphones, motion sensors etc.) and that is positioned at the site of the 
monitored event. 

This platform can be a dedicated one, especially designed to work with the system 
(examples: a bus full of sensors of all kinds - cameras pointing to all directions, 
acceleration sensors, microphones, smell sensors - that travels in a popular tourism 
area, or a boat with sensors, traveling downstream in a wild Whitewater rafting 
experience). 

The sensing platform can also be a one-time, non-dedicated, platform such as a 
mountain climber that is equipped with all the necessary sensors that capture his 
experience, or a racing car or motorcycle that is equipped with sensors and captures 
all the motion and visual aspects of the event in the way the driver or rider 
experiences them. 

An example of another type of a non-dedicated platform can be a wild animal in its 
natural environment equipped with sensors such as tiny cameras, microphones and 
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motion sensors. 

It needs to be understood that the sensing platform exists and performs in real life and 
real time. A tour bus actually travels along its route with a driver and a tour guide; the 
Whitewater raft really goes through all the waterfalls with the risk of rolling over, etc. 

The reproduction platform/platforms - One or more platforms, each containing one or 
more systems for reproducing certain parts of the monitored event (displays, VR 
goggles, headphones, loudspeakers, moving chairs etc.). The platform/platforms are 
to be positioned in places were the reproduction of the event is wanted. 
Unlike the sensing platform that is one and unique for each event, there can be many 
reproduction platforms, allowing as many individuals and groups as desired to 
participate in and experience an event at the same time. 

The reproduction platform is designed to allow best reproduction of the captured 
event. 

It is generally, but not necessarily, a type of a simulator that can reproduce the 
motion, sound, views, touch and maybe even smells (using new and emerging 
technologies). In some cases it looks from the inside and outside, exactly like the 
sensing platform - a bus, a boat, a car or a motorcycle. 

In other cases, the reproduction platform can be a suit dressed by a person witii many 

actuators and reproduction means such as VR goggles that allows the user to feel 

what the person that acts as the sensing platform feels. 

The reproduction experience can combine a platform that serves a group with 

personal gear for each participant for more personahzed experience. 

The reproduction platform also consists of a computer system that processes the 

information coming from the sensing platform and from the user confrols in order to 

send every user only the information he requires (for example: if there are many 

cameras in the sensing platform that cover a large (even 360 degree spherical) field of 

view, the user may use a tracking device mounted on his head along with VR goggles 
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to get only the view in the direction that he is looking at. 
The reproduction platform may also include special effects means such as water 
sprinklers and hoses in the case of the Whitewater raft and heaters for reproducing 
heat when required. 

For reproducing the scenery received from the sensing platform, the reproduction 
platform may also include all kinds of display systems, VR goggles as mentioned, 
projection on walls, privately viewed TV screens, holograms, 3D images and more. 

The communication system - A system that transfers the data received from the 
sensors in the sensing platform to the reproduction systems in the reproduction 
platforms at the required data rate for allowing real time reproduction of the 
monitored event. 

By the nature of the proposed system, this needs to be a broad band system that is 
capable of handling the amount of information that is simultaneously transferred 
between the sensing and reproduction platforms. 

The communication system may be one or a combination of different types. It may be 

wired or wireless, direct (point to point) or networked, digital or analog. 

It can be internet based or have the Internet as a part of it. It can also be based on any 

other existing or ftiture computer and data network system. 

As an option, the communication system may include a large enough buffer for 

storage of incoming data in order to maintain good quality stream of data to the 

reproduction platform in the cost of a short delay between the event timing and the 

reproduction timing. (This buffer may be a part of the sensing or the reproduction 

platforms). 

Bi-directional system 

A system that allows inputs received from the reproduction platform to be 
transferred and used in the sensing platform. In the case of a bi-directional system, 
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the user, while in the reproduction platform, will be able to actively participate in an 
event by sending commands back to the sensing platform. The sensing platform will 
have response capabilities to the commands (example: participation in a real car race 
using an unmanned, remotely operated, full sensory race car). 

System use 

The major ideas behind the proposed system are real life with active 
involvement of the sensing platform in the event and multi-sensory (as many as 
possible human senses participating in the experience) reproduction of the event in a 
desired location. 

This combination makes such an experience, a controlled "adventure". (For example: 
the Whitewater raft may roll over in real life with all the passengers thrown into the 
water. In this case the reproduction platform will roll over (if so designed) and throw 
the virtual passengers into the shallow water around it). 

Some potential uses for such a system: 

- Participation in sports events from an inside point of view and with all possible 
senses. 

- Participation in very unique events that otherwise are out of reach for most people 
(seating in an astronaut seat during the launch of the space shuttle, going into an 
active volcano with a multi sensory unmanned device and more) 

- World wide tourism while in your home town 

- A lesson where students located in different places or located in one place remotely 
from the event, can participate in an event that takes place in a location that 
demonstrates the best the subject of this lesson. 
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